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Abstract. In this report I discuss fluctuation theorems and transient violations of 
the second law of thermodynamics in small systems. Special emphasis is placed on 
free-energy recovery methods in the framework of non-equilibrium single molecule 
pulling experiments. The treatment is done from a unified theoretical-experimental 
perspective and emphasizes how these experiments contribute to our understanding 
of the thermodynamic behavior of small systems. 

1 Biophysics and statistical physics 

Living systems are the most notable example of how matter can organize into states 
of extremely high complexity. The investigation of the structural organization of 
biological matter was boosted since the discoveries of the double helix structure 
of the DNA by Watson and Crick and the ensuing discovery of the structure of 
various proteins half century ago. Microscopic and spectroscopic techniques have 
greatly developed since then and current research is revealing an unprecedented 
richness of details about the functional behavior of living systems at the molecular 
and cellular level. 

Biophysics is an area of science at the interface of physics, chemistry and 
biology. It is probably the most important interdisciplinary area of research whose 
knowledge requires a good understanding of how matter functions at the physical, 
chemical or biological level. While physics during the past has traditionally avoided 
the study of complex systems as imperfect, unapproachable or even uninteresting, 
the fact is that complexity is becoming a more and more common abode for physi- 
cists p. Among all possible disciplines in physics, statistical physics occupies a 



196 



F. Ritort Poincare Seminar 2003 



privileged position as the natural framework to understand the behavior of biolog- 
ical systems at the molecular level. Stochasticity, fluctuations, metastability and 
thermal activation are concepts that are commonly used in statistical physics, yet 
they are also relevant to understanding the great variety of tasks carried out by 
biomolecules. 



Thermodynamics is the discipline that describes the exchange processes of 
energy and matter that occur at the molecular and cellular level. However, ther- 
modynamics, a science inherited in the 18th century from the times of the indus- 
trial revolution, has been inspired by motors and steam engines that proved to 
be indispensable during that time. It is fair then to question the relevance and 
applicability of all this knowledge when scientists immerse into the realm of the 
very small, far from the initial context that inspired Carnot and others. There has 
been a recent interest in the study of the so called work fluctuations and transient 
violations of the second law in systems driven to a non-equilibrium state. Fluc- 
tuation theorems quantify the probability of those non-equilibrium trajectories 
that, taken individually, violate some of the inequalities of thermodynamics. For 
macroscopic systems these trajectories are known to be irrelevant and unobserv- 
able, however at the level of the small, when the energies interested are of order 
of several times ksT, these rare trajectories might become important. Although 
thermodynamic inequalities are known to describe the behavior of average values, 
it is important to explore the implications and relevance of these deviations in 
our understanding of energy transformation processes at the molecular level. A 
quantitative experimental observation and measurement of these trajectories has 
only recently become possible. This report describes these experiments from a uni- 
fied theoretical-experimental perspective and emphasizes how these experiments 
contribute to our understanding of the thermodynamic behavior of small systems. 

Sec.|21is a short reminder about the second law of thermodynamics. It serves 
to explain the importance of fluctuations in small systems and short times. Sec- 
tion describes work fluctuations in the framework of stochastic systems. Particu- 
lar emphasis is put in the case where the system, initially in an equilibrium state, 
is perturbed arbitrarily far from equilibrium. We then discuss the non-equilibrium 
work relation originally derived by Jarzynski. Sec. 0] describes the current state of 
the art regarding experimental measurements of work fluctuations. Sec.[Slpresents 
a digression on single molecule experiments as an excellent framework to investi- 
gate work fluctuations and free-energy recovery methods applied to biomolecules. 
Sec. El describes some of the experiments conducted in the unfolding of small RNA 
molecules under the action of an external force and the test of the Jarzynski equal- 
ity. SecElillustrates a model where work fluctuations can be analytically computed 
as well as a comparison with the experiments reported in the preceding section. 
Finally, Sec. |H1 presents some conclusions and perspectives. 
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2 Few facts about the second law of thermodynamics 

To put in perspective the content of the present article we start by recaUing few 
facts about the second law of thermodynamics ^ i3j . Let us consider a gas consist- 
ing of N molecules enclosed in a given vessel of volume V. The vessel is in contact 
with a thermal bath at temperature T and the gas inside is kept in equilibrium 
(i.e. its macroscopic properties remain stationary), see Fig.^ Particles in the gas 
collide with the walls of the container exerting a pressure P that is function of the 
volume V and the temperature T. Their relation defines the equation of state of 
the gas. In these conditions heat is continuously exchanged between the gas and 
the bath through the walls of the vessel. The state of the gas can be modified by 
changing (e.g. expanding) the volume of the container from an initial volume Vi 
to a final volume Vf. If the transformation is done by keeping the system always 
in contact with the bath at temperature T the process is called isothermal. If the 
transformation is done slow enough then the gas goes through a sequence of equi- 
librium states and the process is called reversible. In general the transformation 
will not be reversible and the gas will be driven to a non-equilibrium state after 
the volume has been expanded. For the transformation Vi — > Vf the first law of 
thermodynamics states that energy is conserved, 

AE ^ AQ + W = AQ + PAV (1) 

with AV = Vf — Vi. From we see that the variation of the energy of the 
gas AE is the sum of the work exerted upon the system W plus the net heat 
supplied from the bath to the system AQ. The difference between heat and the 
other state variables E and V is important. If the volume or energy characterize 
the thermodynamic state of the system, the amount of heat contained does not as 
it is fully interchangeable with work depending on the path followed during the 
transformation. In a general transformation, part of the total work exerted upon 
the system is lost and dissipated in the form of heat to the surroundings. This is 
the content of the second law as stated by Clausius, 

AQ < TAS (2) 

where S{V, T) is a state function called entropy. The amount of heat lost during 
the process is called dissipated work Wdis- It is given by the difference between 
the maximum amount of heat that can be supplied to the system and the actual 
heat supplied (i.e. the right and left hand sides of (0)), 

WAis = TAS - AQ with Vl^dis > . (3) 

Another way to state the content of the second law is in terms of the Helmholtz 
free energy F = E - TS. Using (|1I2I3|I we have. 



AF = AE- TAS ^AQ + W~ TAS = W - Wdis = M^rcv (4) 
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N,V, T (fixed) 




Energy fluctuates 



Figure 1: Schematic representation of a vessel containing molecules that exchange 
energy and momentum with the surrounding bath through different mechanisms 
such as collisions with the walls. If the number of particles is small pressure fluc- 
tuations (due to the fluctuations in the collision rate of the molecules against the 
walls) could be observable with highly sensitive instruments. 

where Wjcv is the so-called reversible work, identical to the free energy change 
AF associated to the initial and final equilibrium states. Only in a reversible 
transformation the equality ||2Jl is satisfied and W — Wrov or Wdis — 0. 

It has been known since the early days of statistical mechanics that the 
work can fiuctuate ^. To better clarify what we mean by this let us go back to 
the previous example and consider the gas of molecules enclosed in the vessel 
depicted in Fig. ^ Let us imagine that we repeat many times the experiment of 
the expansion of the container from Vi to Vf by following always the same variation 
protocol V{t) where t is the time and the whole expansion lasts for a time to ^. 
Then for each experiment a different work value W — J PdV would be obtained 
as the pressure itself is a fluctuating variable. For a macroscopic system pressure 
fluctuations are unobservable due to the large number of molecules (of the order 
of the Avogadro number Na ^ 10^'^). However, for small systems, fluctuations 
could be observable. The result that intensive quantities display thermally induced 
fluctuations was put forward by Niquist for the case of voltage fluctuations across 

^The existence of rare fluctuations have given rise to several paradoxes, see |3 for an historical 
perspective 

■^The simplest protocol would be an expansion of the volume at a constant rate r,V = r = 
or V{t) = Vi + rt 
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a resistance ^ and generalized later on by Welton and Callen . Let us focus on 
the case where the gas contains about 100 molecules and is kept in equilibrium 
inside a volume V at the room temperature T — 298K. Let us imagine that at 
every interval of time (e.g. t = 1 millisecond) we count the number of collisions 
of the molecules against the wall, Nc{t), as well as the average momentum < 
Pc > transferred by the colliding molecules to the walls along each time interval. 
Then, the pressure exerted by the molecules on the walls P will be proportional 
to Nc{t) and < Pc >■ An histogram of the values of P thereby collected would 
show a Gaussian distribution centered around a mean value Pmean (which would 
also coincide with the most probable value) and a variance that decreases like 

This is the content of the law of large numbers. Sometimes the measured 
pressure will be large, sometimes it will be small: the fluctuations will become 
observable as the number of molecules is reduced. Initially these fluctuations will 
show a characteristic Gaussian profile. However, upon reduction of the number 
of molecules, deviations from the Gaussian behavior will be observed. The same 
happens in the non-equilibrium experiment where the volume is expanded. If the 
time to is short enough or the number of molecules N is small enough, the work 
W = J PdV exerted upon the system will fluctuate from one non-equilibrium 
trajectory to another, and the fluctuations will become more noticeable as to and 
N decrease. If the gas is initially in an equilibrium state, then (1213(1 holds in 
average. However, for some trajectories the work will be such that Wdis < and 
the inequality H2I3|I will be reversed. These particular set of trajectories are called 
violating trajectories or transient violations of the second law. 

The theory describing thermal fluctuations in equilibrium systems was put 
forward long ago by Einstein. However, this theory describes fluctuations of ex- 
tensive quantities (such as the energy) in different ensembles in the macroscopic 
regime where fluctuations are subleading of order 0{VV), yet large. The rela- 
tive magnitude of these fluctuations compared to the actual value of the energy 
content is of order 0{1/VV). In macroscopic samples relative fluctuations are of 
order 0{1/\/Na)- This gives estimates for the magnitude of relative fluctuations 
of the order of 10""'^^. A theory of fluctuations for small systems (such as those 
relevant to biophysics) where relative fluctuations are much larger (e.g. of order 
one) should be explored if the theory of fluctuations, as has been developed for 
macroscopic systems, reveals inadequate to explain the behavior observed in future 
experiments. 

3 Fluctuation theorems in non-equilibrium systems 

As we discussed in the previous section the work is quantity that fluctuates among 
different repetitions of the same experiment. Moreover, as compared to other quan- 
tities such as the internal energy, the entropy or the heat transferred, the amount 
of work exerted upon the system is a directly measurable quantity. A relevant 
question is then to ask what can we learn by measuring work fluctuations. 
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To answer this question we consider the dynamical evolution of a system in 
contact with a large bath or reservoir where heat and/or matter can be contin- 
uously exchanged. Both system and bath may appear inextricably linked and no 
partial description of the system can be achieved without considering the behavior 
of the bath and its interaction with the system. The mathematical treatment of the 
combined system plus bath complex represents a formidable theoretical challenge 
and some coarse-graining strategies must be considered to tackle this question. A 
common strategy is to consider a reduced level in the description of the dynamics 
of the system where many details of the bath have been eliminated in favor of a 
few number of parameters (such as its temperature, its pressure or its chemical 
potential). These parameters are thought to be sufficient to characterize the heat 
and/or matter exchange between system and bath. After this reduction is adopted, 
few requirements have to be imposed on the dynamics in order to reproduce many 
of the observable properties. In particular, dynamics must be microscopically re- 
versible (or satisfying detailed balance) and ergodic (all configurations must be 
accessible) to guarantee that the system reaches thermal equilibrium after long 
times so the net heat exchange between system and bath asymptotically decays to 
zero. 

3.1 Work fluctuations in stochastic systems 

It is in the framework of such coarse-grained dynamics that we want to focus our 
discussion and investigate the origin of work fluctuations. A prominent example of 
such reduced dynamics are stochastic Markov processes. The content of this section 
will be useful to establish the notation that we will use throughout the paper. We 
now deepen the mathematical level of our discussion and consider a general system 
described by an energy function E{C) where C is a generic configuration (in the 
example in Sec. El of a gas of N molecules, C would stand for the positions and 
momenta of all molecules inside the vessel) in contact with a bath at temperature 
T. The dynamics are assumed to be discrete in time with elementary step At. A 
trajectory of the system is characterized by the sequence of configurations T = 
{Cfe;0 < k < Ns} where k is the index for the discrete time step and Ng is the 
total number of time steps. The time corresponding to step k is then given by 
t = kAt with t = 0(fc = 0) and tf{k = Ng/ At) denoting the initial and final times 
respectively. The continuous-time limit is recovered if At — > 0, A^^ — > oo with tf 
finite. Dynamics arc then defined by the set of probabilities Pk{C) for the system 
to be found at configuration C at time-step k. The Pk{C) satisfy a master equation. 
For a Markov process the time evolution of these probabilities depends upon the 
form of the rates Wfe(C'|C), defined as the transition probability per unit time to 
go from configuration C to C at time-step k. These rates are assumed to lead to 
an ergodic dynamics (where any pair of configurations are always connected by at 

^Ergodicity is not an essential property if one considers equilibrium restricted to a given region 
of phase space, the sole condition is that all configurations contained in that region of phase space 
must be accessible during the dynamical process. 
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least one trajectory) and satisfy the detailed balance condition, 




(5) 



where /3 = l/ksT, ks being the Boltzmann constant. Under very general condi- 
tions this dynamics guarantees that the system reaches a stationary state where 
configurations are populated according to the Boltzmann weight. The solution to 
the master equation gives the time evolution for the system. 

Now we will treat the case where the system is perturbed in a prescribed way 
and consider the ensemble of all possible non-equilibrium trajectories that start 
from an initial state characterized by the distribution Pq{C). Because dynamics is 
stochastic, it will generate an ensemble of non-equilibrium trajectories by repeating 
the same experiment many times ^. In addition to the configuration C, and in order 
to characterize the perturbation protocol, we introduce a parameter A that specifies 
the value of the control parameter that is changed throughout the non-equilibrium 
process ^ . An important remark is now in place. The control parameter is a variable 
that can change in time but does not fluctuate. The temporal sequence of values 
{•^fejO < k < Ng} defines the perturbation protocol and this sequence of values 
never changes from experiment to experiment. Somehow, the control parameter 
plays a role akin to the temperature of the bath. In particular, for a fixed value 
of A, we require that dynamics is such that the system asymptotically reaches the 
thermodynamic state corresponding to that value of A. To understand how rates 
depend on the value of A we reason as follows. The control parameter usually shifts 
the energy levels of the system according to the relation. 



where A{C) is the observable coupled to the parameter A ^. The simplest assump- 
tion is then to enforce detailed balance for the perturbed rates. 



*The same result holds for deterministic (e.g. Hamiltonian) dynamics. In this case the en- 
semble of non-equilibrium trajectories is determined by the ensemble of initial configurations 
sampled with probability Po(C). The set of phase space points then behaves as an incompressible 
fluid, a consequence of the Liouville theorem. Hamiltonian dynamics can be seen as a particu- 
lar limit of stochastic dynamics, where rates Wk{C'\C) vanish except along the constant energy 
surface E(C) = E{C') and are deterministic, i.e. rates are different from zero only for pairs of con- 
flgurations C,C' connected by the equations of motion. Dynamics is reversible and corresponds 
to J3 with VFfe(C|C) = Wk{C\C'). The case of Hamiltonian dynamics was originally addressed by 
Jarzynski in his original derivation of the non-equilibrium work relation 7 . The stochastic case 
has been analyzed also for general Markov processes by Crooks and Jarzynski |S] |5| 1101 and for 
Langevin dynamics by Kurchan IIP . For a discussion of the similarities and differences between 
deterministic and stochastic dynamics see 1121 . 

^For simplicity we only consider the case of one control parameter. For many control param- 
eters the generalization is straightforward. 

^For instance, if A is a magnetic or gravitational field then A stands for the magnetization 
and the height of the center of mass respectively 



E^{C) = E{C) - \A{C) 



(6) 
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where we used (O in the r.h.s. and the definition AA = A{C') — A{C). We now 
consider the variation of energy along a given trajectory AE{T) = E\j{Cf) — 
Exg(Co) where C,,Cf are the initial and final configurations for that trajectory and 
Ao, A/ are the initial and final values of the control parameter as defined by the 
protocol (trajectory independent). From © this is given by, 



AE{T) =[Y,{E,,{C,+^)-E,,{Ck)]-[Y^ A{Ck)AX,]^AQ{T)+W{T) (8) 



fc=0 k=0 



with AAfc = Afc+i — A/j. This decomposition was proposed originally by Crooks |U] 
to identify work and heat by using the first law of thermodynamics The first 
term in (jSJ is identified as the heat transferred from the bath to the system and 
the second with the work exerted upon the system. We concentrate our attention 
on the the work exerted upon the system along a given trajectory T, 

W{T) = ( ) ^ AAfc = - ^ A(Cfc)AAfc = - / ds\{s)A{C{s))ds 

k=0 ^ fe=0 

(9) 

where we have applied the continuous-time limit in the last term in the r.h.s. 
of As the trajectory is stochastic the work is a fluctuating quantity that can 
be characterized by its probability distribution ViW) defined as, 

V{W)=Yp{T)6(:W -W{T)) (10) 
r 

where T stands for the trajectory and was already defined. The importance of 
V(W) relies upon the fact that it is a quantity that is experimentally measurable 
and therefore is suitable to quantitatively characterize work fluctuations along 
non-equilibrium trajectories. 



3.2 The fluctuation theorem (FT) 

Fluctuation theorems (FTs) provide specific relations for the quantity 'P{W) in 
for general non-equilibrium processes. In fact, until now nothing was said about 
the type of non-equilibrium process and the treatment given in the previous section 
was general. We defined concepts such as the initial and final state, the perturba- 
tion protocol A(i), the trajectory T and the work and heat along a given trajectory. 
The main difference between a general non-equilibrium process and a reversible 
one is the enormous and various type of situations one can encounter in the first 
case. General physically meaningful statements about the properties of the dis- 
tribution H10|l quite probably do not exist and a specific type of non-equilibrium 



'^In the continuous-time limit, both {Cfc, Afe} become C{t), A{t) defining the real-time trajectory 
and perturbation protocol respectively. 
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process has to be adopted to come up with specific results. Several fluctuation the- 
orems have appeared in the hterature depending on the particular non-equilibrium 
context. Many fall into the category of entropy production FTs. The first exam- 
ple in this class was proposed by Evans, Cohen and Morriss JSI for systems in 
steady states. The entropy production there defined bears some resemblance with 
the work that is exerted by the external non-conservative forces that act upon 
the system. Several related theoretical results have followed I15L [T^ as well as 
experiments |17l [TH] . A comprehensive review can be found in . Other more 
complex scenarios can be envisaged, for example in the case where the system is in 
a non-stationary aging state^. In this case, no work is performed upon the system 
and the relevant quantity turns out to be the released heat from the system to the 
bath 

The content of this article deals particularly with systems initially in equi- 
librium with the bath that are driven to a non-equilibrium state by the action of 
an applied perturbation "OT. Therefore, 

P0(C)=Pe,(C) = 2^P(z^^ (11) 

where Z = exp{—(3Exo (C). This case has been studied by Jarzynski [71|H] and 
Crooks [3 El ■ We omit details of the derivation as these can be found in the 
references. A particularly interesting identity has been derived by Crooks |TO| who 
considered the forward and reverse paths in a non-equilibrium process. The forward 
process (F) is characterized by the protocol function Xpit) with the initial state 
in equilibrium at the value Af(0). The reverse process (R) is characterized by the 
inverted protocol function Xnit) = Xpito — t) with to being the total time for the 
forward process and the initial state for the reverse process being in equilibrium 
at the value A_r(0) (which is equal to Af(<o))- The following result is obtained fTU] . 

Simple manipulation of this ratio and integration of one side of the relation from 
—oo to oo gives, 

y_P.(H^)exp(-^)^exp(-^) . (13) 

This is the content of the Jarzynski equality originally derived in [7] for Hamilto- 
nian dynamics (see the footnote^l)- In what follows, if not stated otherwise, we will 
only consider the forward process in a non-equilibrium experiment and drop the 
subscript F for the work probability distribution Pp. We will use the symbol (...) 



° Non-equilibrium aging states are widespread in condensed matter physics. The most common 
example are structural glasses quenched below their glass transition temperature. The aging state 
is characterized by strong violations of the fluctuation-dissipation theorem 1211 . 
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Figure 2: A typical work probability distribution for a small system is useful to 
characterize work fluctuations. Transient violations of the second law are a partic- 
ular class of trajectories with work values characterized by the fact that the the 
Clausius inequality (|2I3|I is reversed. 



to denote the average over all non-equilibrium trajectories generated by a given 
protocol. The Jarzynski equality (JE) reads, 




This expression can be written in a more compact form, 




The Jarzynski equality provides a simple way to derive the second law. Using 
Jensen's inequahty (24, (exp(2;)) > exp((x)) in lfTB|l we obtain, 

W^s>0 . (16) 

An important aspect of the JE l|15|) is that it introduces a way to quantitatively 
estimate transient violations of the second law, i.e. the fraction of trajectories 
whose dissipated work is negative. The reason is easy to understand by inspection 
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of H15|l. The average of the exponential in the l.h.s of H15|) equals 1 only if trajec- 
tories with Wdiss < exist. An analysis of the JE in the near-equilibrium regime 
is useful. Close to equilibrium the distribution P{W) can be approximated by a 
Gaussian ^, 

where PFmcan is the value of the work at the center of the Gaussian and = 
— W its variance. Substitution of H17|l into H14|l gives, 

R=^^ = 1 . (18) 

2WdiskBT 

Throughout the paper we will refer to R as the fluctuation-dissipation ratio as it 
involves a ratio between work fluctuations (T2 and dissipation Wdis ■ This result 
is a particular form of the fluctuation-dissipation theorem in the linear response 
regime. In general, R ^ 1 far from equilibrium. More about the dependence of R 
with the value of the dissipated work will be said later in Sec.[7| We infer from H18|) 
that in the near-equilibrium regime the variance of the work is of the same order of 
the average dissipated work. In the reversible limit Wdis the JE trivially holds 
as Wdis = (or W = Ai^). In this limit the number of trajectories with Wdis > 
equals the number with Wdis < 0, therefore the reversible limit is the case where 
the fraction of violating trajectories is maximal. This may look rather unexpected 
as transient violations might be thought to be a characteristic of non-equilibrium 
processes. 

Transient violations of the second law are expected to decrease fast as the 
average value of the dissipated work Wdis increases (for instance, if the size of 
the system increases) becoming unobservable in the thermodynamic limit. How 
transient violations are suppressed as the system size increases can be understood 
also from the JE. We rewrite (|15|l as, 



, / Wdis\ „ / H/dis\ , n / M/dis\ 



Wdi. 



+ 



Wdi 



(19) 



^The exact form of the P{W) can be very complicated, however the Gaussian approximation 
is expected to hold in the non-equilibrium regime where work trajectories do not deviate much 
from the reversible one. In this way the Gaussian approximation appears tightly related to linear 
response theory. In the latter, quantities deviate from their equilibrium values proportionally to 
the intensity of the perturbation. In a similar way, the deviation of the average work value (the 
first moment of P{W)) from its reversible value AF is expected to be linear with the perturbing 
speed A, see also 1251 for a quantitative estimate of this statement. In other special cases, however, 
the Gaussian result can be exact even for arbitrarily strong perturbations. This is the example 
of a bead dragged through water I2bl . 

'^'^The use of the term fluctuation-dissipation ratio for the quantity R has not to be confused 
with that adopted in glassy systems and usually denoted by x 1211 . For glassy systems x describes 
the ratio between a time derivative of the correlation function and the response function. Albeit 
similar, the two-quantities are not identical as they refer to different non-equilibrium scenarios. 
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where P+, P_ are the probabihties to generate a trajectory with Wdiss > 0, Wdis < 
respectively, i.e. P+ + P_ = 1. In analogous way, the square brackets [..] + , [..]_ 
denote averages (..) but restricted over the subsets of trajectories with Wdis > 
0, Wdis < respectively. In Fig.|2lP+, P- would correspond to the green and white 
areas under the distribution. Using this decomposition it is easy to understand 
how work trajectory values contribute to the r.h.s. of l|19(l enforcing the validity 
of the JE. The value of Wdis increases proportionally to the size N of the system 
(because the work is an extensive quantity) . Because all four quantities appearing 
in the r.h.s. of p9|l are positive, to impose a sum of both terms of 1, the factor 
p_ has to be exponentially small with the average value of the dissipated work 
(i.e. the size of the system) p_ ~ exp(— ©(TV)) to compensate the divergence of 
the corresponding average [..]-. This implies p+ = 1 — exp(— 0(A^)) so transient 
violations are exponentially suppressed with the system size, yet they have to be 
weighed for the JE to hold. 

3.3 Free energy recovery from non-equilibrium experiments 

An important consequence of the JE H14|) is that non-equilibrium experiments can 
be used to recover equilibrium free-energy differences 0, 



The non-equilibrium work relation (|20|l is useful to find the equilibrium free-energy 
change along a given reaction when it is not possible to carry it out reversibly. 
The idea is to repeat non-equilibrium experiments many times and evaluate the 
exponential average in the r.h.s of (|20|l to derive the corresponding work in a re- 
versible process. This formula has been used to recover the free-energy change in 
the folding-unfolding reaction for small RNA molecules, see Sec. El for a detailed 
exposition. However, there are practical difficulties in the applicability of H2()|l as 
the number of trajectories included in the exponential average must be actually 
infinite. This is unrealizable in practice as non-equilibrium experiments can be 
performed only a finite number of times and the finiteness of the number of trajec- 
tories introduces a bias. In what follows we will use AFj^ to denote the estimate 
for the equilibrium free energy AP obtained by using the JE given in (|2U|I with 
a finite number of trajectories. As we remarked in the previous paragraph, the 
number of trajectories required to evaluate the JE grows exponentially with the 
average value of the dissipated work. The dependence of the bias and error with 
the number of pulls has been estimated in some cases 123 EH- In general this de- 
pendence can be quite complicated as it depends on the behavior of the left tails 
of the distribution P(W) which are difficult to analyze in general. 

If the non-equilibrium experiment is done in the near-equilibrium regime then 




(20) 
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it is better to use the fluctuation-dissipation (FD) estimate (I18|l . 



.2 



AFfd = W - 



2kBT 



(21) 



In most cases it is difficult to determine whether the non-equilibrium process is 
done in the near equilibrium regime, so this estimate has to be taken with caution. 
A description of the bias and error for the estimates 1)20121(1 in the near-equilibrium 
case has been recently given. Both are exact in the limit of infinite number of non- 
equilibrium trajectories. Interestingly, when the number of repeated experiments 
is small the JE estimate (|20|l provides a better estimate than the FD H21|l does |28| . 

4 Experimental observation of work fluctuations 

For sake of clarity we discuss now some examples where work fiuctuations are 
experimentally measurable. Some of them have been already measured, others 
might be in the near future. 

We start this tour discussing recent experiments on simple systems. This is 
the case of a micron-sized polystyrene bead confined in an optical trap and dragged 
through a solvent (e.g. water) of viscosity 77 at constant speed v. In average the 
viscous drag on the bead exerts a force that counteracts the force inside the 
trap f{t) = —kx{t) where t denotes the time, k is the stiffness of the trap and 
x{t) is the distance of the bead to the center of the trap. The control parameter is 
the position of the center of the trap xq (t) that moves at a constant speed xq = v 
and the fluctuating variable is the position x{t) of the bead inside the trap (or 
equivalently the force f(t) acting on the bead). The work along a trajectory of 
duration tf is given hy W = J^^ dsf{s)vds. For such case work fluctuations were 
theoretically predicted [^Hl and recently measured |29j . 

Moving to more complex systems, recent experiments have studied the re- 
sponse of 
biomolecules to mechanical force [301 1^ OH ■ The advent of nanotechnologies has 
opened the possibility to exert very small forces on nanosized systems (from pi- 
conewtons IpN — 10~^^N using optical or magnetic tweezers, to nanonewtons 
InN — 10^ N using AFMs). These techniques allow researchers to manipulate and 
study individual biomolecules one by one. Work fluctuations have been already ob- 
served in the unfolding of small RNA molecules (around 100 pair bases) under the 
action of mechanical force. More will be said below in Sec.[Sl In these experiments 
the RNA molecule is held through linker polymers to two micron-sized beads. One 
is held by suction on the tip of a micropipette, the other is confined in the optical 
trap. The molecule is pulled as the distance x{t) between the center of the optical 
trap and the tip of the micropipette increases at a given rate. x(t) therefore defines 
the control parameter. The fluctuating variable in this case is the force f(t) ex- 
erted on the whole system that is measured through the deflection of the bead in 
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the trap. The work along a given trajectory is again W = J^-' f{s)x{s)ds . Work 
fluctuations are observed during the unfolding process due to the stochastic behav- 
ior of the breakage force at which the molecule unfolds. Similar experiments are 
expected to be conducted also for proteins (^3) albeit the large molecular weight 
of such molecules might render the quantitative evaluation of work fluctuations 
difficult. 

One might speculate also on the importance of work fluctuations on the 
behavior of molecular motors and their efficiency. In this case, work fluctuations 
are observable through single molecule experiments by measuring the mechanical 
force exerted upon the motor as it translocates along the template. Examples 
of these motors are DNA [HHl EZ| or RNA (^312111211 polymerases during the 
replication and transcription process, helicases and topoisomerases that unwind 
the DNA ||41| or the ribosome during the transcription process. Other cases include 
the condensation process of DNA inside the viral capside during the infection 
cycle j4U| , and gene regulatory mechanisms (such as transcription factors) ruled 
by protein-DNA interactions that expose large segments of condensed DNA to the 
replication machinery 021 ■ Work fluctuations are predicted to be observable in all 
these systems. Quantitative investigations will be surely conducted in the future. 

Despite of their inherent interest, the measurement of work fluctuations in 
biomolecules has two important drawbacks: accuracy and reproducibility. Indeed, 
few single molecule experiments are fully reproducible due to the complexity of 
conditions and external factors required. Reproducibility at the single molecule 
level is specially serious in biomolecular processes requiring protein activity as 
many external factors strongly affect the outcome of the experiment. Accuracy is 
also an issue specially for measurements with nanometer resolution where stability 
and drift of the machines (e.g. optical tweezers) still impede high accuracy results. 

Accurate and reproducible measurements of work fluctuations might be easier 
in systems with reduced complexity within the traditional domain of physics. One 
example is the already mentioned experiment of the bead in an optical trap moved 
through a solvent. High accuracy recent experimental measurements of the work 
between non-equilibrium steady-states confirm that such measurements are indeed 
possible 03 • Another example that has called our attention recently is the case of 
magnetic nanoparticle systems in a magnetic field '44' . Magnetic measurements in 
microsquids in Grenoble (France) have shown how it is possible to observe magne- 
tization reversal of single magnetic nanoparticles of magnetic moment /i ^ lOOO/is 
(fiB is the Bohr magneton) at low temperatures [45' . For magnetic nanoparticle 
systems the control parameter is the external magnetic field that can be switched 
at a constant speed (ramping experiments). The fluctuating or stochastic variable 
is the value of the field at which the magnetization reverses. The work along a 
given trajectory is then given hy W — —fi /^^ M{t)H{t)dt. The aspect that makes 
these systems specially interesting is the possibility to use SQUID quantum (i.e. 

^'^In these experiments usually x{t) is the distance measured from the center of the bead in 
the trap (rather than the center of the trap) to the center of the bead in the micropipette. This 
introduces a correction to the work that is negligible in most cases 1331 . 
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high-precision) technology to measure the magnetic moment in favor of a higher 
accuracy. Reproducibihty is also easier to achieve as many physical properties of 
nanoparticles can be externally tuned, for example the height of the activation 
barrier and consequently the relaxation time of the nanoparticle as well. Other 
specific properties of magnetic nanoparticle systems makes them specially suitable 
to measure work fluctuations |44| . We may see these experiments done in the near 
future. 

4.1 Measurement of heat fluctuations 

Up to now we discussed about work fluctuations but nothing was said about heat 
fluctuations. The reason is simple. Work is much easier to measure than heat. 
Although transferred heat can be measured by using a small thermometer probe 
(by recording its change of temperature) heat fluctuations are another matter. 
The easiest procedure to measure heat along a trajectory is to use the first law 
of thermodynamics where AQ = Ai? — W. Knowledge of both the work and the 
energy change along a trajectory immediately gives the heat exchanged between 
system and the bath. Measuring the energy content of the system can be hopeless 
in many cases. Only in some special cases this is possible. Here I discuss two 
possible situations. 

The first one corresponds to the case where no energy change occurs between 
the initial and final configuration for all non-equilibrium trajectories. This situation 
is realized in the magnetic example 44^ discussed in the previous section where 
the reversal symmetry of the system under a field induces a zero energy change 
Ef = Ei = —fJ-Ho if the field is changed from —Hq to Hq in a ramping experiment 
(here we assume Hq to be large enough for the initial and final magnetization to 
align in the direction of the field). In general, AE = can be accomplished in 
any non-equilibrium cycle assuming that the initial and final states are identical. 
In the case of the unfolding of the RNA molecule under applied force this can 
be achieved by considering non-equilibrium trajectories where the molecule first 
unfolds and then refolds along a given cycle. 

The second situation corresponds to the case where, due to the inherent 
simplicity of the system, the energy is known. A relevant example is the particle 
confined in an optical trap. In that case the energy of the bead in the trap is 
well approximated hy E = {l/2)kx^ and therefore the value of AS is known for 
each trajectory. The distribution of exchanged heat shows interesting features as 
compared to the work that have been recently discussed by Zohn and Cohen j46| . 

5 Single molecule experiments 

The advent of nanotechnologies has provided instruments and tools for scientists 
to manipulate individual molecules and follow their dynamical trajectories as they 
carry out specialized molecular tasks 07]. The research of molecular reactions 
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Figure 3: A single laser tweezers setup, (a) The laser light is focused into a spot by 
using an objective, (b) A Gaussian profile of light intensity generates a confining 
potential due to conservation of light momentum. The trapping force is induced 
by the difference in the index of refraction between the polystyrene bead and the 
surrounding water. 

performed by individual molecules offers new insight on the importance of fluctu- 
ations and stochasticity in small systems. Mechanical force has been recognized 
as essential to understand the fate of many chemical reactions |3H1 EHl- Several 
force-microscopies are currently available to investigate the individual behavior of 
biomolecular complexes. Atomic force microscopy (AFM), optical and magnetic 
tweezers tweezers have become common tools that allow scientists to measure the 
response of these systems to applied external force. These techniques cover differ- 
ent but overlapping ranges of forces: AFM covers a range of forces spanning from 
several tens of pN up to hundreds of pN, optical tweezers span the intermediate 
region between IpN and lOOpN and magnetic tweezers are sensitive to tenths of 
pN. 

Thermal fluctuations are important whenever the energies involved in molec- 
ular processes are of the order of several fc^T. A quick estimate of the forces 
participating in this regime can be obtained as follows. The typical distance d in- 
volving conformational changes at the biomolecular level is of the order of Inm 

^■^This is only a rough estimate, for instance the base pair distance in DNA is around one third 
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At room temperature T = 298K, Fd = ksT this gives a force F ~ ApN . Opti- 
cal tweezers are ideal to investigate a large region of intermediate forces around 
this value Nowadays, optical tweezers are used to investigate many processes 
operated by biomolecules, ranging from the elastic deformation of nucleic acids or 
proteins to the specific action of enzymes acting on molecular substrates jSO]. A 
typical experimental setup is shown in Fig. |21 Optical tweezers use light momen- 
tum conservation to generate a force gradient on polystyrene beads (of a diameter 
between 1 and 3 microns) that are immersed in water. Light deflection inside the 
beads arises from the difference in the index of refraction between the beads and 
water. In this way a confining potential can be generated by focusing a beam of 
light inside the chamber. To a high degree the confining potential can be consid- 
ered as harmonic. Single beam tweezers can generate confining forces of the order 
of several tens of pN Dual tweezers use two counter propagating beams to gen- 
erate higher forces (up to 150 pN) and have the advantage (by measuring the total 
amount of deflected light) that recurrent calibration is not required to measure 
forces. A fluid chamber is fixed in a movable stage or frame that is controlled by a 
piezo actuator. The chamber is made out of two parallel glass plates separated by 
a thin layer of parafilm. Inside the chamber there is a glass micropipette that can 
trap beads of the size of the micron by air suction. The two counter propagating 
laser beams can confine another bead in the optical trap. To measure forces on 
molecules a tether is attached to the two beads (one in the micropipette, the other 
in the trap). Attachments are designed by chemical treatment of the surface of 
the beads and chemical modification of the ends of the molecule (called labeling) . 
As the stage is moved the force on the bead in the trap (and therefore, on the 
tether) can be measured. The distance between beads is then measured by using 
a light lever and a force-extension curve (FEC) can be recorded. Optical tweezers 
have been used in different fields ranging from physics to biology. A survey of their 
applications can be found in jSUj. 

DNA plays a central role in biophysics |52l IHSI ■ Accordingly its mechanical 
properties have been extensively investigated during the past 10 years |54l I55| . 
Initial investigations on the elastic response of double-stranded DNA under ten- 
sion [SHI have revealed that DNA behaves like an entropic spring as predicted by 
the worm-like chain model of polymer theory |57| . However, at difference with 
other polymers DNA shows structural transitions at modest forces (around or 
below lOOpN) depending on how the molecule is pulled. For example, torsion- 
ally unconstrained double-stranded DNA shows a highly cooperative overstretch- 
ing transition around 65pN EH]- At the origin of this behavior there is the 
double-helix structure of DNA and the associated uncoiling of the two strands. 
However, if both strands are pulled from the same end of the DNA molecule, 

of a nanometer. This is the minimal distance that polymerases have to cover to elongate one 
base pair the newly synthesized strand. 

^^The confining force depends on wavelength of the light. Typical wavelength values are in 
the range 700-lOOOnm, lower frequencies are inadvisable as they can lead to light absorption and 
subsequent heat convection effects around the bead. 
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Figure 4: Force extension curve for a torsionally unconstrained DNA molecule 
of the A bacteriophage, 24000 base pairs long in a water buffer at lOOniM NaCl 
concentration and 7pH. The molecule has a contour length of approximately 8fj,m 
and shows the characteristic overstretching transition around 65 pN. 

then DNA sequentially unzips at constant force following a curve that depends 
on the particular nucleotide sequence [601 . The elastic response of DNA has 
produced many experimental 62 , 65| |^ I65L as well as theoretical investiga- 
tions (S71 EHl EHl EOl El EH to characterize its structural transitions. A particular 
force-extension curve (FEC) showing the characteristic overstretching transition 
of double-stranded DNA is shown in Fig. 0] 

6 Pulling experiments on RNA 

RNA is an essential molecule in biochemistry. It plays an intermediate role be- 
tween DNA (which encodes the genetic information and represents the "software" 
in living organisms) and proteins (which perform specialized tasks inside the cells 
and represent the "hardware" ) . Such intermediate role has been emphasized after 
the discovery that certain RNA molecules (called ribozymes) have catalytic activ- 
ities that are essential in many regulational processes . The relevance of RNA 
has motivated many single molecule studies. Compared to DNA, optical tweezers 
measurements in RNA present additional difficulties to the experimentalist. Not 
only RNA requires more elaboration in the synthesis of the molecular constructs, 
it is also a molecule very sensitive to the surrounding environment and degrades 
easier. Moreover, RNA domains have extensions of few tens of nanometers after 
unfolding, thus requiring more careful and precise measurements. 

Liphardt et al. |7J have pulled RNA molecules and studied their unfolding 
by applying external force using optical tweezers. The molecular construct consists 
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Figure 5: Typical experimental setup when pulling RNA molecules. The molecular 
construct consists of an RNA molecule attached by its ends to two RNA/DNA 
hybrid handles (to avoid formation of secondary structures in the handles). As 
compared to DNA, RNA single molecule experiments present additional difficulties 
as RNA quickly degrades and the resolution required to observe the unravelling of 
the molecule is much higher and of the order of the nanometer. 

of two hybrid DNA-RNA handles that are annealed to the ends of a small RNA 
molecule, Fig O As the molecular construct is pulled the force-extension curve 
(FEC) reflects the elastic behavior of the handles (well described by a worm-like 
chain model [S7]) until a force is reached where the molecule unfolds and a jump 
in the force and distance is observed. 

Very interesting dynamical effects were later observed in small RNA hair- 
pins depending on the pulling rate. For slow pulling rates the molecule was seen 
to follow always the same trajectory and unfold at a reproducible value of the 
critical force ^'^ . At this force coexistence and hopping between the folded and 
unfolded conformations has been observed characteristic of cooperative unfold- 
ing More interesting, as the pulling rate increases larger hysteresis and 
stochastic fluctuations in the value of the breakage force were observed. Typically 
the average value of the breakage force tends to increase with the pulling rate. This 
dependence has been investigated by Evans and Ritchie |76l [77j who have applied 
Kramers theory |78) to describe the activated dynamics of a particle jumping over 
a force-dependent barrier as described by Bell [7^. The study of the loading rate 
dependence of the breakage force in this type of systems has led to new devel- 
opments in what is now commonly referred as single-molecule force spectroscopy 
|8()[l81j . a technique that is useful to investigate the energy landscape of molecular 

Reproducibility of trajectories has always limitations imposed by the unavoidable drift of 
the optical tweezers machine, see the remark at the end of Sec. |4] The accuracy in the value of 
the breakage force can be well controlled. 

^^The dependence of the value of the transition force and the hopping frequency on the sequence 
of the RNA molecule has been studied in 1751 
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Figure 6: Non-equilibrium pulls in the RNA molecule P5abc at different pulling 
speeds in a buffer in the absence of magnesium. Panel A shows a reversible (left 
blue, pulling speed equal to 3-4pN/s) trajectory and an irreversible trajectory 
(right red, pulling speed 52pN/s). Panel B shows unfolding trajectories for two 
pulling speeds, 34pN/s (green) and 52pN/s(red) compared to near-equilibrium 
pulls at 2-5pN/s (blue). Figure taken from 

interactions. Typical unfolding curves showing the pulling rate dependence of the 
breakage force and the resulting hysteresis effects are shown in Fig. El 

Hummer and Szabo have realized |82j that the non-equilibrium work rela- 
tion H2(J|I can be used in single molecule experiments to reconstruct the free energy 
landscape along the force coordinate. The JE H2U|I has been experimentally tested 
in '83' for the P5abc hairpin by repeated measurements of the work done along 
the unfolding trajectory at different pulling speeds. For P5abc in EDTA buffer the 
unfolding free energy change is well known from its secondary structure and there- 
fore is a useful example to test the validity of the JE. Typical work histograms are 
shown in Fig.[7|for three pulling speeds. As expected, as the pulling rate increases 
the average value of the dissipated work increases reaching values of the order of 
4/cbT at the fastest pulling speeds. The main result in 83 is that the JE can 
be used to predict the free energy change for the folding-unfolding transition in 
the P5abc hairpin with a precision within l/csT using a modest number of pulls 
(around 100). Moreover, the JE provides a better estimate for the equilibrium free- 
energy change than the FD estimate does H21|) . The advantage of the former as 
compared to the later has been verified in the near-equilibrium regime (where (|18|) 
holds) , when the number of repeated pulls is not too large ,28^ . 

For the case of the P5abc in EDTA buffer the value of the dissipated work 
is small In general, for larger molecules the JE is expected to give less reliable 



In this buffer conditions kinetic barriers are low. High kinetic barriers and strong irreversibil- 
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Figure 7: Work distributions for the P5abc molecule at different pulling speeds 
(3-5pN/s blue, 34pN/s green, 52pN/s red) measured at different distances along 
the pulling process. Figure taken from [55] , 

estimates for the equilibrium free-energy as the value of the average dissipated 
work increases. An example is shown in Fig. |S1 Typical unfolding curves for a 
three way RNA junction are shown in Fig. |S| The validity of the JE for such 
cases is currently investigated [HH] ■ Other more complex cases imply the unfolding 
of even larger RNA molecules consisting of many domains such as the recently 
investigated L21 RNA ribozyme j84| . 

7 Modeling the experiment 

In [23] a two-state model has been studied to justify the non-equilibrium experi- 
ments in I 83| . The main goal was to confirm that indeed it is possible to obtain the 
equilibrium free energy (within an error equal to IksT) by using the JE with a 
limited number of pulls done in that experiment. Interestingly, with this model it 
is possible to go quite far and find out several results regarding the kinetics of the 
unfolding process. This allows to make also specific predictions about the kinetic 
dependence of the dissipated work that can be experimentally tested as well as 
quantitative statements about the validity of the JE for two-state systems. More- 
over, it is possible to do explicit calculations for the work distribution P{W) and, if 
desired, go beyond the Gaussian case (fTTjl . Two-state models provide phenomeno- 
logical descriptions of systems that can exist in two different forms, therefore the 
following considerations are expected to be applicable to many systems beyond 
the folding-unfolding dynamics of RNA molecules. In fact, the two-state model 
has been shown to provide a good description of the folding-unfolding dynamics of 
small DNA or RNA hairpins that display strong cooperativity 86 , as well as 
structural transitions in polymers [HHI ■ The model is represented in Fig. where 
the two conformations (folded and unfolded) are separated by an intermediate 

ity are obtained either by going to faster pulling speeds (however, this is not easy to accomplish 
due to limited experimental capabilities) or in different buffer conditions. For the latter, high 
kinetic barriers and many intermediate states are obtained in the presence of divalent cations 
such as magnesium that establish specific tertiary contacts between some bases. 
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Figure 8: The left figure shows the structure of the junction in the 16S domain of 
the SOS ribosomal RNA subunit. The right figure shows some unfolding curves at 
3.5pN/s. Courtesy of Delphine Collin. 
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Figure 9: The two-state model with an intermediate barrier. The parameters are 
the free-energy gap AFq, the unfolding distance Xm, the height B of the inter- 
mediate barrier and the distance of the intermediate barrier to the folded state 
Axu^f- Figure taken from [21]. 



barrier located at a distance Axf^u from the folded state and Axu^f from the 
unfolded state, the value Xm = Axf^u + Ax^^f being the total distance between 
the folded and the unfolded states. The free energy difference between the two 
states is denoted as AFq and the height of the barrier is indicated as B. Transi- 
tion rates between the folded and the unfolded state are thermally activated and 
force dependent [THj . 

kf^uif) = k„rkocxp{-P{B - fAxf^u)) 
fc„_/(/) = k,nko exp(-/3(B - A^^o + fAxu^f)) (22) 

where / is the external force, /3 = l/fc^T, fco is a microscopic attempt frequency 
and km is a contribution arising from the handles, the bead in the trap and the 
machine The rates ()22|) satisfy detailed balance, a necessary condition for the 
equilibrium regime to be characterized by Boltzmann populations of the folded 
and unfolded states. The dynamics of the two-state model under the action of 
an external force has been analyzed in detail for the case of no-refolding process 
along the unfolding curve |76[ I77| . also called a first-order Markov process. This 
particular case is analytically tractable and specific predictions about the form of 
the work distribution can be made j89| . 

In the theoretical treatment of a non-equilibrium pulling experiment the force 

^'^In 1221 we continue to use the term F for the Gibbs free energy. To be precise we should 
use instead G as for the experimental conditions the temperature and pressure of the bath are 
held constant. 
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can be taken as the control parameter and increased at an approximately con- 
stant rate r = f. The work exerted along a given trajectory is taken asW — J xdf. 
The probability distribution cannot be exactly evaluated in closed form and only 
the moments of the distribution can be computed in a perturbative scheme where 
the average dissipated work is assumed to be several times fcsT. The results have 
been given in j25| for the first two moments. These give the average dissipated 
work and its variance, from which the value of the fluctuation-dissipation ratio R 
can be inferred. The first two moments are the most relevant quantities as they 
can be directly compared with the experimental results. A general result for the 
average dissipated work can be derived in the linear-response regime where the 
pulling speed is slow compared to the hopping frequency at the transition force 
ft (i.e. the value of the force at which the folded and unfolded populations of the 
RNA molecules are equal in equilibrium). The linear-response regime is therefore 
characterized by the dimensionless parameter p defined as, 



/tfctotal(/t) 

where fctotai(/t) = ku^f{ft) + kf^u{ft) is the total rate at the transition force. 
When p < 1 the average dissipated work is given by, 

W^s - pAFo + Oip^) (24) 



The linear dependence of (|24|l can be used to derive estimates for the relax- 
ation time of the molecule that might complement other type of kinetic measure- 
ments (such as the measurement the folding-unfolding hopping frequency right 
at the transition force). In Fig. ^] we show the results for these quantities as a 
function of the pulling rate using some kinetic parameters in l|22|l to fit the experi- 
mental data. The dashed line in the left panel of Fig. 1101 shows the linear response 
prediction H24|) . Note that the experimental points fall off the linear response curve, 
showing that the pulling rates investigated in [84| explore the far from equilibrium 
regime. This is an important result because it shows that, despite of the smallness 
of the value of the average dissipated work (in the range 2 — AksT) the experiments 
were carried out far from equilibrium reinforcing the validity of the Jarzynski re- 
lation in such regime This conclusion is substantiated by the dependence of 

^® Strictly speaking this is not true. As remarked in Sec. |1] the control parameter in pulling 
experiments using optical tweezers is not the force but the distance between the center of the 
optical trap and the tip of the micropipette. The pulling speed r is always an average value of 
the force-dependent speed along the unfolding curve. Under this approximation (which typically 
introduces a small correction) , using the force or the distance as the control parameter turns out 
to be equivalent as d(fx) = fdx + xdf, see footnote (**) in 1251 for a related remark. 

^^Indeed, had the experiments been carried out in the near-equilibrium regime, then the recov- 
ery of the equilibrium free-energy change using the JE would be expected due to the smallness of 
the average values of the dissipated work. The fact that the value of the dissipated work is small, 
yet the system is far from equilibrium, is consequence of the smallness of the RNA molecule. 
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Figure 10: Average dissipated work (left) and fluctuation-dissipation ratio R (right) 
as a function of the pulhng speed. The circles in the left figure are the experimental 
values. The values of the kinetic parameters characterizing the rates ()22|l have 
been chosen to fit the experimental data. The dashed line in the left figure shows 
the linear-response formula 124(1 . The two horizontal dashed lines in the right 
figure limit a region of pulling speeds where the FD estimate is expected 
to approximate well the free-energy change during the folding-unfolding reaction. 
Figure taken from |25j . 

the fluctuation-dissipation ratio (right panel in Fig. llOj) which shows a strong non- 
monotonic behavior for pulling speeds above 20pN/s. Further evidence endorsing 
the fact that experiments were carried out far from the equilibrium regime is in- 
ferred from the shape of the work probability distributions P{W) The results 
are shown in the left panel of Fig. 1111 and were obtained from numerical simu- 
lations of the model using the kinetic values of the fltting parameters as derived 
from Fig. llUI Gaussian behavior is a flngerprint of the near-equilibrium regime, see 
the discussion in the paragraph containing footnote |51 in Sec. 13.21 As a comparison 
we show in the right panel of Fig. 1111 the histograms obtained from the experi- 
ments. Both theory and experiments bear a close resemblance. Fig. II II reveals the 
existence of long tails at both sides of the work distribution that strongly deviate 
from the Gaussian behavior. 

Finally we provide an answer to the original question with which we started 
this section. Can we support the main result of the experiment jSSj where a small 
number of pulls (around 60) was enough to obtain the equilibrium free energy 
(within an error of IfcsT) by using the JE? In Fig. El we compare the bias error 

^•^It must be emphasized though that this statement would not be vaUd if, by some reason, the 
parameters used to fit the kinetic data were completely off from the actual values. Although far- 
fetched, this possibility cannot be ruled out as the two-state model here considered is probably 
a crude approximation to the real description of the unfolding process (see the discussion in 
Ref. 1491 ). New experiments in other RNA hairpins are required to reach a better understanding. 
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Figure 11: Work distributions obtained for the model (left) compared to the experi- 
mental results. Strong deviations from a Gaussian behavior are predicted, specially 
in the left tails of the distribution. Figures taken from |25l I8;^j . 



obtained from the two estimates (|2UI21|I as well as from the average dissipated 
work W^dis along the force coordinate. The different bias errors are defined as, 



B 



dis 



B 



FD 



= AFFD-AF = Wdis{l~R) 



B 



JE 



= AFjE - AF = - log(^exp(- 



Wdis 



(25) 
(26) 

(27) 



where (|18|) and H20I21() have been used. The bias error depends on the num- 
ber of pulls iVpuiis- To obtain these bias values we have averaged H25I26I27|I over 
a large number of sets of experiments, each set characterized by TVpuiis repeated 
pulls. Full convergence to the correct free-energy, as the number of pulls increases, 
corresponds to a vanishing bias throughout the force axis. From Fig. E| we can 
see how the values obtained from the average dissipated work (|25l) and the FD 
estimate ()26f) quickly converge to limiting curves characterized by a finite bias. 
However, the bias obtained from the JE (|27|l slowly converges to zero and practi- 
cally vanishes only for TVpuiis ~ 10^. Also, from the JE bias H27|) shown in Fig. 1121 
we learn that 100 pulls are enough to get an estimate of the free-energy within 
IksT of error for the folding-unfolding reaction, by using non-equilibrium work 
values at the two largest pulling speeds. We mention also that the FD estimate 
works well in the large force region of the force axis (around 20pN) but not in 
the intermediate force region (around 14pN) where it develops a bump. The rea- 
son why the FD works so well at high forces has it root in the behavior of the 
fluctuation-dissipation ratio R shown in the right panel in Fig. ^| There R has 
been evaluated from a pulling protocol where the force is ramped from to a 
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Figure 12: Behavior of the different bias defined in (|25I2()I27|) along the force 
coordinate. Figure taken from |25| . 

value around 20pN. In that case R is close to 1 for a large region of pulling speeds 
(delimited by the two horizontal dashed lines). Whenever R ^ 1 the FD estimate 
is expected to work well if the number of pulls is not too small. 

The number of pulls required to obtain the equilibrium free energy with an 
error within IksT can be estimated by measuring B'^^ averaged over many sets, 
each one containing A'puHs repeated pulls. The dependence of the bias B"^^ with 
-Epulis is shown in Fig. 1131 The decay of the bias with A^puHs can be very well 
approximated by a power law (-/Vpuiis) "^'^^ where the exponent a{r) depends on 
the pulling rate (or the average dissipated work as they are related each other). 
The bias B'^^ shows as a crossover to a l/A^puHs behavior for -/VpuHs > 1000 in 
agreement with the prediction by Wood 90 . For a Gaussian process in the near- 
equilibrium regime the value of the exponent a{r) has been estimated numerically 
[2H| and is relatively close to the values found in this case. From Fig. E| we see 
the number of pulls required for the bias B"^^ to be equal to IksT (indicated as 
the horizontal dashed line). This number of pulls is then shown in the inset of 
Fig. ^] as a function of the average dissipated work (also the pulling speeds are 
indicated). Under certain assumptions (see [HI]), and only for modest values of the 
average dissipated work 191 1 , this number of pulls can be shown to approximately 

grow as exp(i?_^^) with i?_ a constant of order unity that characterizes the left 
side tail of the work distribution. For the experimental values of the pulling speed 
considered in the experiment (the region limited by the square box shown in the 
figure in the Inset) the required number of pulls to get the desired accuracy is of 
the order of several tens as done in the experiment. 
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Figure 13: Main panel: Bias error (in units of ksT) for the Jarzynski average H27() 
as function of the number of pulls for different pulling rates (from bottom to top: 
34 (green), 52 (red), 75 (violet), 100 (black) pN/s). Data have been averaged over 
1000 sets and error bars correspond to 100 sets. Inset: Number of pulls necessary 
to obtain an estimate for the equilibrium free energy within fc^T and fit to the 

estimate iVpuiis ~ ^^Pi^-T^^ which yields i?_ ~ 1.5. 



All in all, the two-state model reproduces quantitatively many aspects of the 
non-equilibrium behavior observed in the experiment | 84 | and justifies the test of 
the validity of the JE there claimed. 

8 Conclusions 

Thermodynamics represented a great step in the development of science. It pro- 
vided a general framework to understand all natural processes that involve the 
transformation of different sorts of energy (mechanical, chemical, electromagnetic) 
into work and heat. While work can be viewed as useful energy, heat represents 
energy that is not useful. The second law of thermodynamics limits the amount 
of useful work that can be extracted from heat. As heat abounds in nature it 
seems plausible that the level of organization that we see today in the form of bi- 
ological matter originates from certain properties that characterize heat exchange 
processes. 

Statistical mechanics provided a mechanistic picture of the abstract concepts 
of thermodynamics in terms of the average behavior of a large number of atoms or 
molecules and their interactions. According to this picture, thermodynamic quan- 
tities are not strictly constant but fluctuate around their average values. However, 
the amount of these fluctuations is small relative to the value of the thermody- 
namic quantities themselves. Much larger fluctuations are hardly observable and 
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become irrelevant as the raacroscopic level is approached. 

Fluctuation theorems go beyond this statistical level of description by quan- 
tifying fluctuations arbitrarily large whose magnitude can be of the same order of 
the average value. This is the content of the non-equilibrium work relation orig- 
inally derived by Jarzynski In that case, work trajectories quite far from the 
average or most probable trajectory, have to be properly weighed for the equality 
to be satisfied. As the system size increases (or as the time increases for steady 
state systems) the probability to observe these rare trajectories quickly decreases. 
Were we repeat many times the dynamical experiment, the time we should wait 
until finding a trajectory that notably reduces the bias error associated with the 
equality, increases exponentially with the size of the system, ultimately reaching 
values that are of the order of the Poincare recurrence time. We then considered 
the suggestive fact that most of the non-equilibrium trajectories that enforce the 
validity of the Jarzynski equality, are also those that inspired many of the para- 
doxes underlying the statistical interpretation of heat and that were proposed in 
the early days of statistical mechanics. 

What is the fundamental value of these rare trajectories described by fluctuation- 
theorems? If fluctuation theorems were just theorems, the value would be predom- 
inantly academic. There is of course interest in using the non-equilibrium work 
relation to obtain free energies for transformations that cannot be carried out re- 
versibly. However, it might be possible that fluctuation theorems have an added 
fundamental value. They could provide physicists with a tool to explore the validity 
of the principles underlying some energy transformation processes. In the same way 
that classical mechanics proved inadequate to describe energy exchange between 
radiation and matter at the atomistic level, one could imagine that current the- 
ories describing thermal exchange processes occurring at very small length-scales 
or short times should be accordingly revised. In fact, all fluctuation theorems use 
in one way or another the concept of microscopic reversibility. This condition en- 
sures that systems thermalize if left to evolve for a long time. However, it might 
be possible that microscopic reversibility holds only in average, that transitions at 
the microscopic level have unexpected properties with important consequences for 
biology and life . If this were the case, while the average behavior would be well 
described by current dynamical theories, rare fluctuations might display a more 
refined pattern beyond our current expectation. 

Biological matter tends to organize reaching fantastic levels of complexity. 
Although it is often tacitly assumed that our current understanding of physics 
will provide clues to fill into the many "details" that surround the organization of 
biological matter, the truth is that bold ideas will be probably needed to go beyond 

^^We did not mention in this feature extensions of the classical non-equilibrium work relation 
to the quantum regime. Although several papers have recently appeared in the literature |g!Z| 1931 
1941 1951 . the concept of a quantum trajectory and quantum work are to be clarified and the first 
experimental attempt to test the corresponding quantum relations is still to be done. 

Ideas such as purposiveness of changes have appeared recurrently in the context of natural 
selection in biology, see for instance 1961 . 
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the present state of the art. Biological matter will become a common laboratory 
for physicists in order to test and understand many of the questions that transcend 
the behavior of ordinary matter. Single molecule experiments have opened a vein 
of research for physicists, that require the combination of a general knowledge 
of physics, chemistry and biology to grasp the most relevant aspects required to 
unravel the behavior of living matter at the most fundamental level. 
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